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(57) Abstract 

A method is described for managing data records stored in non-volatile memory in a disk drive system with cache memory. 
A variable-length directory containing descriptors of disk records is used to locate a selected record non-volatile memory. A table, 
ordered sequentially by record number, is used to quickly locate a record in non-volatile memory without having to perform a 
time-consuming search. In order to efficiently utilize space in non-volatile memory, a list is kept of free space for storing record 
descriptors. After an initial nominal allocation, additional free space is allocated only when required, thus further increasing the 
efficiency of use of non-volatile memory. 
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METHOD FOR M2^6IN6 DATA RECORDS IN A 
CACHED DATA SUBSYSTEM WITH NON-VOLATILE MEMORY 

FIELD OF THE INVENTION 

This invention relates generally to computer disk 
5 drive systems with associated cache memory and non- 
volatile memory subsystems, and more particularly, to 
a method for efficiently managing write operations to 
disk, in a disk drive system in which updated track 
images are kept both in volatile cache memory and in 
10 non-volatile cache memory. 

PROBLEM 

Many disk drive systems have associated cache 
memory to increase the speed with which data stored in 
the disk system can be accessed. Generally, cache 

15 memory is volatile; that is, any data stored in cache 
is lost if a power failure occurs. Data which has 
been modified or updated by a computer system is 
vulnerable to such a loss of power between the time 
the data is written to cache memory and the time it is 

20 written back to the disk drive system. In order to 
ensure the integrity of this updated data that has 
been written to cache memory, a copy of each disk 
record that has been updated is also written to non- 
volatile cache memory (NVM) , so that it will remain 

25 intact in the event of a power failure. 

Each track image staged to cache memory is fully 
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represented in cache memory all records . on the 

track being stored in cache memory sequentially/ by 
record nxamber. However, the only records which must 
be copied into KVM are those records which have been 
5 modified (as the result of a write operation) after 
the track was staged from disk into cache memory. 
Once a track has been staged in cache memory, records 
contained in the track may be randomly written to, or 
modified by, a computer system. This means that WVM 
10 will generally contain, a variable number of out-of- 
sequence records. This situation makes KVM difficult 
to manage in a manner which is efficient and which 
requires a minimum amount of system time and overhead. 
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SOLUTIOK 

The present invention employs a novel method for 
managing records stored in non-volatile memory. As in 
the prior art, a directory containing record 
5 descriptors (pointers to NVM records) is used to 
locate a selected record in NVM. However, the method 
of the present invention uses a variable-length 
directory to save space in NVM. This reduces the cost 
of the disk drive system because non-volatile memory 

10 is relatively more costly than volatile types of 
memory. In addition, the prior art required searching 
through the directory of randomly-ordered descriptors 
in order to locate a given record in NVM. In 
contrast, the present invention uses a table of 

15 ordered directory entries to cjuickly locate a desired 
record, without having to perform a time-consuming 
search. The table is ordered sequentially by record 
number, and each entry therein contains the position, 
in the directory, of the record descriptor 

20 corresponding to a given record number. Thus, for 
example, record niunber n in NVM can be quickly located 
in two steps. First, the nth entry in the table is 
directly addressed. This entry indicates the location 
of the record descriptor for record number n, which 

25 descriptor is then directly addressed. The descriptor 
contains the address of record n, which has now been 
found without conducting a sequential search of the 
record descriptor directory. 

Furthermore, since records in NVM are generally 

3 0 re-written back to disk in record number order, the 
sequentially ordered table provides for an effective 
method of performing this re-write operation. 

In order to efficiently utilize the NVM space, a 
"free list" of available ("free") space for storing 
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fecord descriptors is also kept in NVM, After an 
initial nominal allocation, additional free space is 
allocated only when required, thus further efficiently 
using non-volatile memory • 



wo 93/21579 



PCr/US92/03299 



BRIEF DESCRIPTION OF THE DRAWING 

Figure 1 shows, in block diagram form, the 
interrelationship between the disk drive system, an 
associated volatile cache memory subsystem, a track 
5 image read from the disk drive system into the 
volatile cache memory subsystem, the non-volatile 
cache memory subsystem, and a computer system; 

Figure 2 shows the non-volatile memory subsystem 
containing a plurality of non -volatile memory 
10 directories, each containing a plurality of segments 
for storing record descriptors; and a data buffer area 
containing a plurality of records that have been 
modified by the computer system; 

Figure 3 shows the non-volatile memory subsystem 
15 containing a modified record table partitioned into a 
plurality of record descriptor lists, and containing 
a corresponding plurality of non-volatile memory 
directories ; 

Figure 4 is a flowchart showing the steps 
20 associated with the storing of a copy of a record in 
non-volatile memory; and 

Figure 5 shows a record descriptor list in the 
modified record table, an associated non-volatile 
memory directory, and the data buffer area. 



wo 93/21579 



PCr/US92/03299 



DETAII.ED DgSCRIPTION 

rigure 1 shows, in block . diagram form^ the 
interrelationship between the disk drive system 100, 
an associated cache memory subsystem 120, a track 
5 image 22 read from tiia disk drive system. 100 into the 
volatile cache memory sxibsystem 120, a non-volatile 
cache memory sxibsystem 13 Oj^ and a computer system 110. 
Note that the non-volatile memory subsystem 130 
contains a modified record table 140, a plurality of 

10 non-volatile directories 150, and a data buffer area 
160, the contents of which are described below* 

Whenever the computer system 110 requests that 
data be written to or read from the disk drive system 
100, the computer system 110 transmits information 

15 over line 102 identifying the location of the desired 
data within the disk drive system 100, usually 
specifying drive number (if .the disk drive system 100 
has more than one drive) , cylinder, track, and record 
number. Upon issuance of a request by the computer 

20 system 110 to read a record from the disk drive system 
100, an image 22 of the track containing the requested 
record is staged (read) from the disk drive system 100 
over bus 104 into the volatile cache memory subsystem 
120 ► The computer system 110 can then access the 

25 retrieved record in the cache memory subsystem 120 
over bus 106. 

After a track image has been read into cache 
memory 120, as records are updated, or modified, by 
computer system 110, space in a non-volatile memory 

30 data buffer 160 is allocated for a copy of these 
updated records- The computer system 110 stores an 
updated copy of the requested record in the cache 
memory subsystem 120 over bus 122, and also stores, 
over bus 124, for the purpose of data integrity, a 
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copy of the modified record or changes thereto in the 
non-volatile memory data buffer 160. Therefore, the 
record changes are safeguarded in the event of a power 
failure between the time the record has been modified 
5 by the computer system 110 and the time the record is 
written from the cache memory subsystem 120 back to 
the disk drive system 100. A segment 210 of non- 
volatile memory 130 is also allocated for managing and 
organizing the record with respect to other records 

10 located on the same track image 22. 

When a write operation requested by the computer 
system 110 is complete, with the modified record 
having been successfully written from the cache memory 
subsystem 120 back to the disk drive system 100, all 

15 space used in non-volatile memory 130 for storage and 
management of the track associated with the record is 
deallocated. 

If the write operation was unsuccessful because 
of a data integrity problem, the track image 22 is 
20 restaged into volatile cache memory 120 and a copy of 
the modified record in non-volatile memory 130 is 
written to the cache memory subsystem 120, and the 
write to disk operation is attempted again. 

Non-Volatile MemorY Architecture 

25 Figure 2 shows the non-volatile memory subsystem 

130 containing a plurality of non-volatile memory 
directories 150, each containing a plurality of 
segments 210, 210' for storing record descriptors 212; 
and a data buffer area 160 containing a plurality of 

30 updated records 113 read from the computer system 110. 
After a track image 22 has been read from the disk 
drive system 100 into the cache memory subsystem 120, 
when a record on the track is updated by the computer 
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system 110, a segment 210 of non-volatile memory 130 
is initially allocated as an area for storing a 
plurality of record descriptors 212, each of which 
contains information pertaining to records in the 
5 track image 22. More specifically, each record 
descriptor 212 references a modified disk record 113 
that has been written to the data buffer area 160 in 
non-volatile memory 130. A record descriptor 212 
includes: (1) a flag (s) field indicating whether the 
10 associated record has been modified, (2) a pointer to 
a copy of the record in non-volatile memory, and (3) 
a "count key data field", containing the cyii^^^^r and 
track number of the record in the disk drive system 
100, a record identification number, and the length of 
15 the record. 

The non-volatile iaemory segment 210 contains a 
control area 214 and space for 24 record descriptors 
212, with siibsequent segments 210' being allocated as 
necessary, each segment having sufficient space to 
20 store 32 record descriptors, because the subsequent 
segments do not require additional control areas . A 
control area 214 contains data used to manage an area 
of memory^ and is a concept well-known in the art. 
Every allocated segment 210 or 210*^ is the same size. 
25 Typically, the 24 record descriptors 212 in the 
initial segment 210 are sufficient for a given track, 
but an exceptional track may require up to five 
segments 210,210' to be allocated. It should be noted 
that more or less space could be allocated for a 
30 segment 210,210', depending on the specific 
characteristics of the disk drive system 100 and the 
program being run on the computer system 110. Only 
the required nxomber of segments 210,210' are allocated 
for a given tracks 
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All segments 210 and 210' for a given track are 
located in a variable size directory 150, in non- 
volatile memory 130, containing pointers to records 
which have been modified. This modified data record 
5 directory is referred to as a non-volatile memory 
directory 150. When the computer system 110 requests 
that a record be updated, a non-volatile memory 
directory 150 is allocated for that track. 

Modified Record Table 

10 Figure 3 shows the non-volatile memory subsystem 

130 also containing a modified record table 140 
partitioned into a plurality of record descriptor 
lists 350, and containing a corresponding plurality of 
non-volatile memory directories 150* After a non- 
15 volatile memory directory 150 is allocated, an area in 
non-volatile memory 130, called a modified record 
table 140, is also allocated for storing indicia of 
location of record descriptors 212 that are later 
written to the non-volatile memory directory 150. 
20 Each time a track is read from the disk drive system 
100, a record descriptor list 350 for that track is 
created in the modified record table 140. Each record 
descriptor list 350 is of sufficient size to 
accommodate 128 entries 354, which nvimber of entries 
25 is typically the maximum possible nximber of records 
contained on one track of an individual disk in the 
disk drive system 100 (only several of the 128 entries 
are shown for purposes of clarity) . 

All free memory locations (those locations which 
30 are not occupied by record descriptors 212) in each 
non-volatile memory directory 150 are put into a free 
list 216 in the non-volatile memory directory 150 for 
the corresponding track- The free list 216 is used 
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for storing new record descriptors 354 for the track* 
Each time a segment 210 or 210' is allocated^ a 
counter, indicating the number of available record 
descriptors for the corresponding track, is 
5 incremented accordingly. 

The free list 216 is a singly-linked list with 
the first available memoiry location 117 in the free 
list 216 being pointed to by a head pointer 356 
located in the record descriptor list control area 
10 352. 

Data Record Writing to Non-Volat ile Memory 

Figure 4 is a" flowchart showing ttie steps 
associated with the storing of a copy 113' of record 
n in non-volatile memory 130 and Figure 5 illustrates 

15 the position of data in non-volatile memoiry 130. When 
a disk record n on track m is updated as a result of 
a write operation, the following steps then occur: 

(1) At step 402, a copy 113' of record n is 
written to a data buffer area 160 in non-volatile 

20 memory 130; 

C2) the free list 216 for track m is checked at 
step 404 to determine whether there are any available 
record descriptors 212 in the non-volatile memory 
directory 150 for track m? 

25 (3) if, at step 406, there-is no space remaining 

in the free list 216 (i.e., tiiere are no available 
record descriptors 212) for track m, then at step 408 
another segment 210' of, non-volatile memory is 
allocated to the free list 216, and the available 

30 record descriptor counter (not shown) is incremented 
by 32 at step 410; 

(4) at step 412, a record descriptor 212' for 
record n is written to the first available location 
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504 in the free list 216 in the non-volatile laemory 
directory 150; 

(5) at step 414, the integer corresponding to 
the positional offset (rank) A of the record 
descriptor 212' from the beginning of the non-volatile 
memory directory 150 is then written to the nth 
location 502 in the record descriptor list 350' for 
track m in the modified record table 140; 

(6) the available record descriptor counter in 
the free list 216 is decremented, at step 416; and 

(7) at step 418, the free list head pointer 352 
is adjusted to point to the next entry in the free 
list 216. 

Note that step (5) above accomplishes the 
ordering of the records for a given track in non- 
volatile memory 130. 

Record Location in Non-Volatile Memory 

Figure 5 shows a record descriptor list 350' in 
the modified record table 140, an associated non- 
volatile memory directory 150, and the data buffer 
area 160. In order to locate a modified record 113', 
in non-volatile memory 130, with a record number n, on 
track number m, the record descriptor list 350' for 
track m is first located in the modified record table 
140. The nth entry 502 in the record descriptor list 
350' is then located. This nth entry 502 contains the 
offset A, into the non-volatile memory directory 150, 
of the entry 504 containing the record descriptor 212' 
for the record to be located. The offset A is the 
number of entries from the beginning of the non- 
volatile memory directory 150 to the location of the 
desired modified record descriptor 212'* The entries 
in the record descriptor list 350' and in the non- 
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volatile memory directory 150 are directly located 
(directly addressed) using memory address arithmetic 
methods well known in the art. The modified record 
113' is found by referring to. the entry. 504 in the 
5 non-volatile memory directory 150, which entry 504 
contains the address of the record 113' in non- 
volatile memory 130,. 

It is to be ej^ressly understood that the 
claimed invention is not to be limited to the 
10 description of the above disclosed preferred 
embodiment but encompasses other modifications and 
alterations within the scope and spirit of the 
inventive concept. 
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KE CLAIM: 

1. In a disk drive system which stores data in 
a plurality of tracks, each of said tracks containing 
a plurality of data records, each of said data records 
having an associated record nuiaber, said disk drive 
5 system having an associated volatile memory subsystem 
and a non-volatile memory subsystem, said non-volatile 
memory subsystem having random-access memory for 
storing a plurality of said data records and a 
plurality of record descriptors, each of said record 
10 descriptors comprising a pointer to one of said data 
records in said non-volatile memory subsystem, a 
method for managing said data records in said non- 
volatile memory subsystem, comprising the steps of: 
allocating a data buffer area in said non- 
15 volatile memory subsystem for storing said data 
records ; 

writing, to said data buffer area, a copy of 
each said data record which has been modified since 
having been read into said volatile memory subsystem; 
20 compiling, in said non-volatile memory 

subsystem, a directory of said modified data records, 
each entry in said directory having indicia of 
location of a corresponding modified data record in 
said non-volatile memory subsystem; 
25 compiling, in said non-volatile memory 

subsystem, a list for each of said tracks which has 
been read into said volatile memory siibsystem, each of 
said lists having entries, ordered sequentially by 
said record number, of the records in said non- 
30 volatile memory subsystem, each of said entries in 
said list having indicia of location of a 
corresponding said record descriptor in said modified 
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data record directory; and 

locating said selected data record in the 
non-volatile memory sxabsystem, by indexing to the 
record descriptor in said list iri said non-volatile 
memory siibsystem. Using the record number as an offset 
from the beginning of the list, to find an entry in 
the list, and then using the value of the found entry 
as an offset into said modified data record directory 
to find the entry having indicia of location of the 
selected data record in said non-volatile memory 
subsystem. 

2* The method of claiia 1 wherein: 

the step of compiling said lists is 
performed in said volatile memory sidssystem^ 

3* The method of "claim 1 wherein: 

the step of compiling said directory of said 
data records includes: 

allocating a segment of said non-volatile 
5 memory equivalent to the size occupied by the sum of 
a pre-determined pliirality of said record descriptors . 

4. The method of claim 1, further including the 
steps of: 

tabulating, in said non-volatile memory 
subsystem, a list of free memory locations available 
5 for storing said record descariptors ? and 

allocating space for said record descriptors 
from the list of free memory locations. 

5. The method of claim 5 wherein space for the 
record descriptors is allocated in segments capable of 
containing between 16 and 64 descriptors per segment. 



35 



40 
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6. The method of claim 5 wherein the step of 
allocating is in response to a request for writing a 
data record to said disk drive system. 

7. The method of claim 6 wherein said segments 
are allocated only when additional space is required 
for storing additional record descriptors. 

8. In a disk drive system which stores data in 
plurality of tracks each containing a plurality of 
data records, each of said data records having an 
associated record number, said disk drive system 

5 having an associated non-volatile memory subsystem 
having random-access memory for storing a plurality of 
said data records, said non-volatile memory subsystem 
containing a plurality of record descriptors, each 
said record descriptor comprising a pointer to one of 
10 said data records in said non-volatile memory 
subsystem, a method for managing said data records in 
said non-volatile memory subsystem comprising the 
steps of: 

allocating space for a modified record table 
15 in said non-volatile memory subsystem having n 
entries, each entry being of sufficient size to 
contain indicia of location of a memory location in 
said non-volatile memory subsystem, where n is equal 
to the number of said data records per said track; 
20 allocating a segment of space for an non- 

volatile laemory directory, capable of containing v 
said record descriptors, where v is a variable 
integral number between one and the number of said 
data records per said track, said segment being 
25 allocated from said free list; 

maintaining a free list, in said non- 
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volatile laemory subsystem^ of the unused memory 
lopations in the directory which are availcible for 
storing said record descriptors; 

30 defining ah area in said non-volatile memory 

STJbsystem as an non-volatile memory data buffer for 
storing said data records which are modified; 

writing said data records to the non- 
volatile memory data buffer; 

35 compiling, in the modified record table, for 

each said track, a list of said record descriptors for 
said records written to said non^volatile memory 
subsystem, said record descriptor list having entries 
sequentially ordered by record number, each said entry 

40 in said list having indicia of location of a record 
descriptor in said non^volatile memory directory, said 
record descriptor corresponding to one of said data 
records in said non-volatile memory data buffer; cind 
locating said selected data record in said 

45 non-volatile memory subsystem,, using the record niunber 
of said selected data record as an offset from the 
beginning of said record descriptor list to an entry 
in said list, then using the integer value of said 
entry in said list as the rank of position of an entry 

50 in said non-volatile memory directory, said non- 
volatile memory directory entry having indicia of 
location of said selected record in said non-volatile 
memory siibsystem. 

9. The method of claim 8, wherein the step of 
compiling includes ,^ for each of said data records 
which has been modified as a result of a request for 
writing said data record to said disk drive system: 
5 storing, in the first available location in 

the free list, a record descriptor corresponding to 



wo 93/21579 



PCr/US92/03299 



-17- 

said modified data record; and 

storing, in the Nth location in the record 
descriptor list in the modified record table for the 
10 associated track, the integer corresponding to the 
offset, into the non-volatile memory directory, of the 
entry containing the record descriptor for said 
modified data record, where N is the record number of 
said modified record • 

10. The method of claim 8 wherein the step of 
allocating a segment of space for the non-volatile 
memory directory occurs in response to a request for 
writing a data record to said disk drive system, when 

5 said request requires more space than currently 
allocated in the free list for the track associated 
with the record; and v is an integer between 8 and 64, 

11. The method of claim 8 wherein the step of 
allocating space for the modified record table occurs 
in said volatile memory subsystem. 
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